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Abstract. To enhance the learning and teaching of geographic information 
systems in higher-education Earth sciences, we present ongoing research 
that aims to identify the strategies and concepts that underlie the suitabil- 
ity-mapping process. Linking quantitative and qualitative data analysis, our 
research cl arif i es the differences between experts and students and suggests 
i nstructions to hel p students acqui re probl em- sol vi ng expertise. 
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1. Introduction 

In the geosciences, geographic information systems (GISs) are especially 
useful in two areas: digitization and suitability-vulnerability mapping. 
Land-use-suitability problems are often solved with multicriteria spatial 
analysis (MCSA) methods. These methods combine various criteria to ob- 
tain a map that indicates areas that are more or less apt to solve a location 
problem. The decision analyst must make various choices that lead to a host 
of cartographic issues: the standardization method for each criterion, crite- 
rion layers, decision rules, and weights for relative importance (Malczewski 
2004). 

Making suitability maps implies applying a cognitive process that involves 
the representation, interpretation, and (mathematical) treatment of geo- 
graphic data and requires a deep knowledge of Gl S. 
From an educational point of view, our purpose is to examine which cogni- 
tive processes underlie the visual thinking, strategies, and cartographic 
ski I Is requi red by M CSA tasks and how these processes evolve i n goi ng from 
a novice to an expert. Understanding the transition from novice to expert is 
a prerequisite for developing effective learning environments for students 
at all levels (Petcovic&Libarkin 2007). 

This research is based on a quantitative-based qualitative approach to ana- 
lyzing verbal data. The main goal is to understand how to represent the 
knowledge used in the pertinent cognitive processes. In quantifying the 
qualitative data, the researcher searches the data for patterns and trends 
and then categorizes these according to codes or concept indicators (Chi 
1997). 



I n this paper we first present the methodology adopted; then we show the 
preliminary results and the didactical scaffolding that help students acquire 
expertisein suitability mapping. 



2. Background 

2.1 . Suitability land-use mapping: semantics and cognition 

The process of making suitability maps involves overcoming conceptual 
obstacles, which we summarize here. 

We first consider the mathematical procedures (i.e., the GIS-MCSA ap- 
proaches), including weighted summation and Boolean operations. These 
are easy to implement within the GIS environment by using map-algebra 
operations and cartographic modeling. The principle of the method is also 
easy to understand and intuitively appealing to decision makers. However, 
GIS implementati ons of the weighted-summation procedures are often used 
without a full understanding of the assumptions underlying this approach. 
In addition, the method is often applied without complete insight into the 
meanings of two critical elements of the weighted-summation model: the 
weights assigned to attribute maps and the procedures for deriving com- 
mensurate attri bute maps (M alcewski 2006). 

For perceptual organization and categorization related to functional- 
representation concepts of map syntactic, we rely on Tversky and 
Hemenay's basic- level's categories theory (1984). These basic- level catego- 
ries, including events as well as objects, are categories for which we can 
form a single image. Categorization is strongly linked to data classification 
for choropleth maps (Mac Each r en 1995). The map resulting from MCSA is 
a choropleth: it displays quantities (plethos) relative to areas (Khore) via a 
graduated color scale. There are both mathematical and graphical issues to 
solve when making choropleth maps. Implementing such a map depends 
primarily on the choice of discretization method; that is, how to divide the 
statistical series to map into classes or intervals (Beguin & Pumain 2007). 
In this map, all map units falling into a particular category are depicted 
with identical symbols; this perspective is based on the acceptance that, in 
classical categories, any element must be as representative of the category 
as any other element. The cartographic concept of a choropleth map is 
based on the classical theory of categorization being "correct." The under- 
standing derived from choropleth maps depends on how categories are in- 
terpreted by users (M acEachren 1995). 

To interpret and use suitability maps, we rely on Marr's (1985) visual map 
processing and MacEachren's (1995) perceptual organization, categoriza- 
tion, and judgment. Human vision is good at extracting shapes from a visu- 
al scene, assessing depths and relative size, and noticing movement. A key 
feature is that the visual system should emphasize contrast more than abso- 
lute illumination and higher acuityfor color hues than for color value. Thus 
color value and saturation can be ordered whereas hue cannot. A second 
key is the system's ability to group the elements that neurological image 
processing renders into "objects." 

Continuing in terms of interpretation, another feature of land-use- 
suitability mapping is that it must be "checked" repeatedly throughout the 
process: its validity is determined by its correlation with the representation 
of the actual terrain. Indeed, suitability maps are often superimposed 



(draped) over base maps, 3D model of terrain, virtual globes, or maps with 
administrative boundaries. Our study is particularly concerned with super- 
positions with relief, which are created by shading on DEM. Their interpre- 
tation and reading is then linked to the perception of depth of a two- 
dimensional (2D) or three-dimensional (3D) scene: for that we rely on the 
taxonomy of depth cues provided by Kraak (1988) and particularly on the 
"pictorial" cues that are related to the object's structure and the way the 
structure organizes visual input. By using shading and/ or color and shad- 
ow, many cartographers create an effective pi an- view relief representation 
that suggests depth in a non- perspective approach. 
One last specificity of suitability maps concerns their use for decision mak- 
ing. As J ankowski and Nyerges (2001) showed, maps play only a limited 
support role in various stages of the decision process and a reduction of 
cogn i ti ve compl exi ty i s needed . 

These theoretical aspects are treated in our approach, which strives to high- 
light the key differences between experts and novices in interpreting a suit- 
ability map. 

2.2 Expert-novice continuum: some cognitive models 

The cognitive sciences have a rich research tradition that has examined ex- 
pertise across a variety of fields, compared the characteristics of experts and 
novices, and considered how expertise is acquired. Abstract thinking skills, 
problem- solving strategies, storage and recall of a wide array of infor- 
mation, and ability to work flexibly within a domain of knowledge all exem- 
plify what it means to bean expert (Petcovic & Libarkin 2007). 
We rely on M acEachren's map schemata as structures for representing and 
organizing concepts that link together cognitive processing of map-derived 
information, the roles of knowledge, experience, practice, and training on 
the part of map readers (MacEachren 1995). There are significant differ- 
ences i n schemata avail able to domain specialist versus novices, so applying 
appropriate schemata requires learning and practice (MacEachren 1995). 
I n a map-reading task where the map corresponds to a known landscape, 
experts might be expected to encode it not just as separate "chunks," but 
within an overall template that incorporates the relationships between the 
groups of objects viewed (Kent & Chang 2008). For the experienced map 
reader, an extensive vocabulary exists that defines and labels complex enti- 
ties (Edwards, in MacEachren 1995). 

Specifically, experts may be (1) focusing on the distinctive features of a dis- 
play to establish how it may differ from the norm, (2) identifying what is 
familiar and typical and that therefore requi res minimal processing, and (3) 
spatial -feature matching either the geometric or symbolic information on 
the map with geographic- feature matching in the landscape being repre- 
sented (Chang et al. 1985). Another main strategy for approaching spatial- 
problem solving was highlighted by Crampton (in MacEachren 1995): ex- 
perts used active self- analysis and error- prevention with progressive repeti- 
tion to focus i n on a sol uti on . 

The study of expertise can be used to improve instruction to develop the 
visualization skills and schemas necessary for parsing complex spatial in- 
formation. 



3. Methodology 



3.1. Goals of current study 

Conceptualization and visualization of suitability maps involves a complex 
interaction of skills and mental schemas. The purpose of this study is to as- 
sess the concepts, actions, and strategies that underlie the mental processes 
in a suitability-mapping task. Specifically, our study addresses one main 
question: What operations and concepts are used by experts and students 
when solving suitability- map problems? 

We used the design- based- research approach (Edelson 2002) to design 
experi ments to shed light on this research question. This approach employs 
multiple methods allowing cycles between theories or models and field ob- 
servations and experiments, and it includes descriptive data representa- 
tions as well as quantitative and qualitative analysis. 

3.2. Participants 

We conducted our survey with two third-year- undergraduate student popu- 
lations, each well distinct and composed of GIS and MCSA novices. The 
students were majoring in geoscience (i.e., geologists); 15 were engineers 
specializing in environmental science. The students worked in groups, we 
analyzed three groups of geologists and three groups of engi neers. 
Three specialists participated in the experiment as experts: a geophysicist, a 
cartographer, and a GIS engineer. They were questioned individually at 
their work place and were asked to complete a predesigned activity ("con- 
trived tasks"). The approach used by an expert to perform a task gives in- 
valuable insight into how experts reason. Both the experts and the students 
were gi ven th e same su i tabi I i ty map task. 

3.3. Learning sequence: site location problem 

We designed a GIS learning sequence in which student subjects were given 
a typical site- location problem to solve. To favor authentic learning (Simon 
1962), students were asked to work in genuine professional situations. They 
had to perform a feasibility study and locate suitable sites for a ski resort in 
the southern French Alps. The approach used to solve the problem is based 
on multicriterion methods and requires tools for spatial analysis. More pre- 
cisely, it involves analyzing environmental criteria, making surface analysis 
calculations, reclassifying data, and creating suitability models. The GIS 
used was ArcGIS 10.0. The sequence took 17 hours and was divided into 
five sessions of three hours and one session of two hours (S6) over a period 
of two weeks. 

3.4. Data Collection 

To understand how an apprentice I earns a trade, one possibility is to ob- 
serve the I earner i n context. We col I ected three types of data from the I earn- 
ing sequence: 

• producti ons: maps made by students or experts; 

• verbal data: students' verbal interactions during key moments of 
decision making (audio and video records) and experts' "thinking- 
aloud" protocols (video records); 

• three open-ended questionnaires. 



We present herein an analysis of the verbal data, which were transcribed. 
For each expert, we analyzed three hours of recordings; for each of the six 
student groups we analyzed 2.5 hours of recordi ngs. 

3.5. Verbal-Data Analysis 

Our approach relies on Chi's (1997) method of quantifying a qualitative 
analysis of verbal data. 

Verbal analysis is a methodology for quantifying the subjective or qualita- 
tive coding of the contents of verbal utterances. I nstead of representing the 
ideal knowledge, the goal of the method here is to understand what a learn- 
er knows and how that knowledge influences the way the learner reasons 
and solves problems, be it correct or incorrect. The method of coding and 
anal yzi ng verbal data consi sts of the f ol I owi ng ei ght steps: 

1 Reduce or sample the protocols; that is, reduce data by selecting a partic- 
ular activity; 

2. Segment the reduced or sampled protocols; 

3. Develop or choose a coding scheme (taxonomic categories scheme); 

4. Operationalize evidence in the coded protocols; 

5. Depict the mapped formalism; 

6. Seek pattern(s) in the mapped formalism; 

7. 1 nterpret the patter n(s) and its (their) validity; 
8. Create interrater reliability. 

For al I the processes that were appl i ed to resol vi ng the probl em of site I oca- 
tion, we retai ned four fundamental tasks: 

TO = Data standardization and classification 
Tl= Weighted Sum 
T2=Map Analysis 
T3= Site Choice 

Once the corpus to be coded was decided, we then had to segment the ver- 
bal utterances to identify the unit of analysis. The defining cut can occur at 
many points, revealing units of varying granularity, such as a proposition, a 
sentence, an idea, an interchange as in conversational dialogue, or an epi- 
sode. 

We developed our formalism in an interactive bottom-up and top-down 
process: categories were derived from the subjects' explanations and inter- 
actions and were enhanced by some theoretical background. We defined 
five categories of "objects": algebraic, color semiotics, orographic, geo- 
graphic, and analytic concepts. 
I n the segment protocols we searched for tags or keywords, such as "moun- 
tain" or "valley" for the orographic object's category and "ski resorts" or 
"names of localities" for the geographic object's category 
Two coders worked on the data (the first author of this paper and an inde- 
pendent coder), each making a complete analysis of the data. Each disa- 
greement between the coders was considered and reanalyzed in the seg- 
ment protocol. The rate of agreement between the coders was 87.8%. 
The analysis is based on a taxonomy founded on the characterization of 
tasks, actions, operations, and conceptual objects: tasks (Figure 1) are di- 
vided into actions, each action is characterized by one or more operations, 
and each operation is characterized by one or more conceptual objects. 



Figure 1 presents an example taken from the segmentation of task TO: ac- 
tion 1 has one operation (11) and one object (A]), action 2 has two opera- 
tions (2.1 and 2.2), operation 2.1 has an object (A]), and operation 2.2 has 
three objects (Al Rl Gl). 
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Figure L Example of segment protocols from sampled corpus. 



4. Preliminary results from qualitative analysis 



A Taxonomic categories scheme 

• Objects 

We establ ished a set of codes that fit a taxonomi c categori es scheme specifi c 
to land-use suitable mapping. 

Our taxonomy is composed of five categories, each representing a concep- 
tual object. Each object is defined by descriptors that are assigned a code. 
Specifically, 

1 The algebraic object, which encompasses all the verbal elements 
pertinent for rendering the Geographic I nformation data in mathe- 
matical form. Thisobject has six descriptors, which areidentified in 
Table 1 





Descriptors 


Example quotes 


A1 


exclusion, selection, Boolean 


"At first took, we can exclude certain things, 
make a mask: let's say the slope is between 
15° and 60° and the altitude is between 1000 
and 3000 rn"[e1J 


A2 


Thresholds, number and order 
of classes, digitization, 
synthesis 


"What scale for the classes, ! don't 
remember any more ... 1, 2, 3? I'll make a 
hierarchy" [e1 ] 


A4 


Hierarchy of criteria, 
representation of weights, 
correlation between criteria 


"So altitude is important, 3, slope as well, 3, 
distance, 2, orientation, 1. Ill do it in percent, 
it'll be easier to interpret" [e1] 


A5 


Weighted sum, combinations 


"Try one with altitude 40 (A) plus 30 (P) plus 
20 (E) and plus 10 (CLC)" [g1] 


A6 


Measurements (areas, 
perimeters, pixels) 


"We could chose with respect to the area, 
define a minimum number of pixels, then 
vectorize to calculate the area" [e1J 




Vector intersections 


'To cross check the data we'll use 
intersection fools" [e2] 



Table L Algebraic objet and its descriptors. 



2. The col or object, which encompasses all the verbal elements related to 
the vari abl e of vi sual col or . Thi s obj ect has f i ve vari ati ons (see Tabl e 2) 



Codes 


Descriptors 


Example quotes 


V1 


Hue and values 


"The colors are good because red 

moanc hinh ^frnnn ' nr&&n 
means weak" [e2J 


V2 


Contrast, disassociation, and 
degradation 


"Which map is the clearest? 
There it's the clearest, a lot of 
blue jumps out, the other is more 
fuzzy but there is less blue" [e3] 


V3 


Color harmony {the palette) 


"To rasterize it SP1 1 chose the 
blue-yellow-red palette" [e3] 


V4 


Edges, boundaries 


"You have to clearly differentiate 
between light and dark red" [g4] 


V5 


Presentation and transparence 


"You can act at the level of the 
transparencies, but 
transparencies on black and 
white ... whistle" [g3J 



Table 2.Color semiotics objet and its descriptors. 



3. The orographic object, which encompasses all the verbal elements related 
tothegeomorphological description of theterrain. Thisobject has five vari- 
ations (seeTable 3). 



Codes 


Descriptors 


Example quotes 


R1 


All references to knowledge of 
the terrain (alpine) 


" The Alpes du Grand Serre has 10 
times less snow than the Col de Porte, 
which is buried" [g1] 


R2 


Common nomenclature: 
mountain, lowlands, valley, 

c Inno 


"We have nothing in the mountains and 
everything in the lowlands" [g2] 


R3 


Specialized nomenclature : 
ridge, thalweg, cone 


"1 don't think it would be good to cross 
a red zone, that means you're crossing 
a thalweg; a valley" [g3J 


R4 


Representations of relief: 
contours or DEM 


"Don't we have a contour map?" [g1] 

"I'm going to do a shading to see the 
relief [e1] 


R5 


Lithology, cliffs 


"It (the calculation) removes cliffs, but 
look at Saint-Eynard, it leaves it (in 
green) and it's too steep" [e1] 



Table 3. Orographic objet and its descriptors 



4. The geographic-feature object, which encompasses all the expressions 
related to the geographic elements of the region being analyzed. This object 
has si x vari ati ons (see Tabl e 4) . 



Codes 


Descriptors 


Example quotes 


G1 


Known places, ski resorts, towns, 
communities! 


"Below 2000 there's not much 
left, you can see there's nothing 
left in the Vercors; that leaves the 
Oisan, Belledonne, the Grandes 
r\ousses, anu zne i auieier 
laughter fe2J 


G2 


Road network 


"Just look at the roads" [g2J 


G3 


Drainage network 


"Because you're next to water 
there, you can put in pumps" [g5] 


G4 


Representations: topographical 
map, background map 


"1 need a map background, I'm 
using the Scan 100" [e2] 


G5 


Green spaces: forests, protected 
areas 


"I've got to have the protected 
areas" [e2] 


G6 


Infrastructure: ski lifts 


"You can't put your ski lifts like 
that all along your thing, and how 
do you go down, you need things 
that converge toward the lifts" 
fa31 



Table4. Geographic feature objet and its values. 



5. The analyzed-suitable areas object, which encompasses all the expres- 
sions related to observing one or more zones with the goal of evaluating 
capability. This evaluation consists of six types of observations (see Table 
5). 



Codes 


Descriptors 


Example quotes 


An1 


Suitable areas and correspondence 
between criteria, weights, and the 
goals of the problem 


"When the slopes are very steep then 
their weights have to be smaller" [e1] 


An2 


Suitable areas and correspondence 
with the legend, colors, and values 


"We have the value 8 (legend) in white 
and 1 in black, low is not good and 
high is good" [g3] 


An3 


Suitable areas and correspondence 
with the nature of the terrain 


"Bourg d : Oisans is there and the Deux 
Alges ... besides, look, it's there 
(zoom) and it's in green!" [e1] 


An4 


Suitable areas and restriction 
character of the map 


"This map has a few less red zones, 
more precise, it's a little better, then 
there's this one that adds some zones, 
you go there the thing there it'll 
increase, so this one won't" [g5] 


An5 


Suitable areas compared on different 
suitability maps 


"The other is fuzzier but it has less 
blue, it restricts the zones more and 
luckily the zones are the same (proper 
zones on both maps)" [e3] 


An 6 


Suitable areas and in need of more 
information 


"There we're on quite a few green 
zones, it's hard, we'd have to make a 
mask again with higher-value zones 
and then compare with the scree 
slope and the protected areas" [e1J 



Table 5. Analyzed-(suitable) area objet and its descriptors. 



• Actions 

To identify the solution path, we defined a formalism to capture the se- 
quence of acti ons and operati ons that are used i n the mappi ng process. 
All the actions stemming from solution processes for experts and students 
were indexed. In all, 30 actions were identified; each characterized by one 
or more operations. Control operations were of particular interest to us, so 
we present them br i ef I y bel ow. 

• Control operations 

We categorized control errors based on Ohlsson's Theory of Learning from 
Error (1997). "Suitability mapping is a sequential-choice task characterized 
by sequential ity, multiplicity, and effect orientation. [...] What does it mean 
to commit an error in a sequential-choice task? It is an action that is not on 
the path to the intended goal. This action is inappropriate or useless in a 
specific context and it involves environmental effects, called error signal. 
Since knowledge guides the action, to correct an error is to improve future 
performance by revisi ng thefaulty knowledge structure." 

We summarize hereunder the three control-error categories that we de- 
fined: 

1 Veri f i cati on : acti ons that val i date or anti ci pate a choi ce; for exampl e, by 
comparing the same zone on several maps or different zones that have 
the same type of terrain, or by verifying the algebraic results in the leg- 
end. Some exampl es of quote are "I sum the two, that way that i n 2 wi 1 1 
be the good one" [el]; "It's very sensitive to altitude there. It gives ra- 
ther the change in altitude, which is artificial. The altitude is exagger- 
ated; weshould have put morecl asses in altitude to attenuate." [el] 



2. Diagnostic: actions that lead to recognition of sources of error; for ex- 
ample, the inappropriate use of a function or a request, the inappropri- 
ate definition of the threshold of classes, or the incorrect attribution of 
weighting to the criteria. Some examples of quotes are "I made a mis- 
take when I wrote ... wait, I'll do it one more time. I put parentheses 
around the expression ... I don't remember if it's AND or OR" [el]; 
"there is a problem there, we still have the same thing so it doesn't 
mean anything! Stop! Everything is wrong! It's this one that's incor- 
rectly classified!" [g2] 



3. Correction: actions allowing intervention to correct the error; for exam- 
ple, by modifying the function, the expression, the order of the classes, 
or the hierarchy of the criteria. Some examples of quotes are "I remain 
persuaded that we have to redo the classification from lto 9 for each, 
because we're not working on the same values" [e3]; "We have to redo 
everything. Should we remove the orientation or this from the sum? 
Ok, that's much better!" [g2] 



5. Preliminary results from quantitative analysis 

To highlight the patterns, the quantitative analysis included counting the 
instances of objects, control operations, and actions based on presence, 
absence, recurrence, or comparison between experts and students (See 
Fig. 2). We discuss these patterns below based on the details of the opera- 
tions undertaken (not shown here). 
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Figure 2. Summary of variable instances for the four main tasks. 

For the phase where data is standardized and digitized (TO), we find in gen- 
eral that the experts use more actions and objects than the students. For 
example, the action of exclusion by thresholds (T01), which corresponds to 
creating masks and selecting which data to treat (chunking theory), is used 
by al I three experts but by none of the students (TOlExperts = 5 occurrences 
andT01Students=0 occurrences). See Fig. 3. 
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Figure 3. Occurrences of the ID actions of task TO for experts and for students 



In addition, control operations (and in particular those of verification and 
diagnostic, CV = 11 and CD = 14, respectively) undertaken at this point by 
the experts are more important than those undertaken by the students 
(CExperts = 37, CGeologists = 4, and CEngineers = 12 for the engineers). 
SeeFig. 4. 



TO Control operations for Experts 




CD9=data management 
CDS=values and symbology 
CD6=classes and weights 












Experts 


CD3=algebra 


























m j= CD2=function 














£ ^ = CDl=difference 














g u g CV8=notional 
U u q CV7=correlatian 












■ el 

■ e2 












u CV5=camparisan 












■ e3 


CV2=anticipatian 














CVl=validation 














2 4 6 I 
Occurrences 


i 10 



TO Control operations for Geologists students 



CD9-diilG managc-mcnE 
CDS=vial ut'ii jnd 'iyinbulc^.y 
C D6= daises a i id wt-'i^li Li 
CUi^lguLira 
u CD? hjnrtiori 
„ .if 1 f m rfitfetpnce 

g "ii Q CV7 rnrrplatinn 
u g cnmparisnn 
f.VJ ann'ripalinn 
CV'l=V3l caiior 



Occurrences 



TO Control operations for Engineers students 
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Figure 4. Occurrences of TO control operations for experts and for students. 



Thus, the experts put controls in place very early in the problem- solving 
process. In this phase of data preparation, the experts use more objects 
than do the students; in particular the algebraic object (AEx =45, AGeol = 
U AEng =39) and the geographic object (GEx =9, GGeol =0, GEng =3). 
SeeFig. 5. 
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Figure 5.0ccurrences of TO conceptual objects for experts and for students. 



In the phase where weights and weighted sums are allocated for the criteria 
(Tl), the students undertake more control operations than the experts be- 
cause they spend more time correcting mistakes. 

I n T2, we f i nd that the experts use vi sual -effect tool s to i mprove the anal ysi s 
(zoom, transparence) (T22 Experts = 2, T22students = 0). They also use 
control actions such as verification with the relief and detection of thresh- 
ol d effects. These acti ons are I ess used by the students. 
I n T3, one or more sites are chosen by the experts with respect to controls. 
The choice is based especially on the addition of information and the detec- 
tion of know zones (T32Experts = 3 and T32 students = 1). 



6. Conclusions 

The prel i mi nary results of our study reveal the differences i n strategi es ( i .e, 
the series of actions and operations) employed by experts and by students 
and track the paths taken to solve the problem. We extract from our data a 
model consisting of five categories of conceptual objects required to solve 
the problem. Finally, we proposed a model consisting of three categories of 
control operations. The differences between experts and novices are thus 
described at the level of concepts, operations, and controls. 

The field of GIS education should consider how expertise is related to 
teaching and learning. Some operations or methods of execution as well as 
concepts that experts use and that may be absent i n the strategi es that stu- 
dents use suggest that a different type of pedagogical scaffolding should be 
provided. We suggest the foil owing: 

methodological scaffolding: create raster mask as "partitioning"; 

- thematic scaffolding: provide rules and notions in semiotics (use of col- 
ors); 

- strategi c scaffol di ng: suggest control I i ng for conf I i cts, errors, or anoma- 
lies (threshold effect); 

- technical scaffolding: learn to manipulate visual-effect tools (relief, 
transparency, virtual globe) in GISsto enhance visual analysis. 

We are currently testi ng some of these scaffol di ngs. 
Strategies that help students acquire expertise in problem solving require 
explicitly teaching expert strategies, using of real-world problems, and or- 
ganizing collaborative groups to encourage metacognition (Petcovic & Li- 
barkin2007). 
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